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Abstract 

The purpose of this study was to study the effect of a multimedia computing program on the 
production of activities and self-regulated learning processes in 18 students of the Dentistry 
postdegree (Celaya, Mexico). A multi-method design (quasi-experimental, pretest-post-test 
and qualitative: Think aloud protocol) was used. Self-regulated activities were identified 
with the MSLQ questionnaire. Results of the MSLQ pretest/post-test questionnaire didn't 
show an intervention effect. In contrast, the qualitative methodology allowed the 
registration of a high frequency of self-regulated dimensions on the metacognitive area, on 
the making of inferences (cognitive area), and on the planning time and effort (behavioural 
area). Our data revealed the usefulness of a qualitative methodology for the understanding 
of the complex nature of the self-regulatory processes on learning environments based on 
computers. 
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Introduction 

The last decades, increased attention has been given to the Information and 
Communication Technologies (Its) and the influence on all aspects of our 
economic, social, political and cultural contexts. The implementation of the 
Its at the University required a careful follow up by all those who wish to go 
deeper on the characteristics of this new social and technological 
environment according to Saenz (2004). 

As stated by Bartolome (2004) or Kirkup and Kirkwood (2005), on 
Higher Education we are late assumers or simply reticent ones. Enormous 
technological potential must be ordered, systematized and applied on the 
new reality that we are living. Starting with the psycho-educational 
paradigms of learning based on the transmition of information and the 
generation of knowledge as the socio-cognitive theory and the information 
processing theory, a multimedia computing program was studied on 
students of the Dentistry Postdegree Program. The study was conducted 
under a multi-method perspective with a quantitative and qualitative 
boarding, procedure suggested by different authors (Desoete 2008, Van Hout 
Wolters 2000; Veenman, 2007). 

New information and communication technologies in Education 

On this century, facing the new circumstances and paradigms arose on the 
education field and ranging from the use of the ITs, its application and 
usefulness constitute a central theme for research since its reach and 
dimensions aren't well determined. 

The virtual learning environment (VLV) was defined as the physical 
space where the new technologies such as satellite systems, the internet, 
and the multimedia and interactive television take place. The virtual 
learning environments are important because the human mediator is not 
available physically, although a human component is highly necessary in 
the learning process. Regian and Shebilske (1992) considered the virtual 
reality to be a superior environment to increase spatial abilities because the 
interface preserved the spatial characteristics of the simulated world and 
the motor actions of the student. The characteristics of virtual reality as an 
ideal learning environment had the following qualities: 

• Great flexibility for the creation o virtual o artificial situations. 

• The ability to offer a feeling of sense. 

• The possibility of giving the user the control of the media and to be 
able to interact with objects and people. 

• The possibility to obtain feedback from objects and people (Middleton, 
1992). 

Aguaded and Cabero (2004), stated that to the success of VLV depended 
on factors such as the instruction process and didactic strategies and 
attitudes that student's and teacher's have.. Otherwise, the same author 
(Cabero,2003) referred that the ITs located in the educational field is not 
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feasible to supply the didactic media known nor be the solution to all the 
problems that the relationship raised by the relationship teaching-learning 
phenomenon. 

Nevgi et al. (2006) addressed the issue of motivational strategies for 
learning in students of the virtual university. The IQ form is a project of the 
University of Finland that involved the disciplines of information 
technology, computer sciences and education. The theoretical support of the 
project extended from the mediated learning theories, the distribution of 
cognition and theories of multiple intelligences by Gardner and the work of 
Pintrich. 

Social cognitive theory of learning and self-regulation 

The social cognitive learning theory is based the work of Miller and Dollard 
in 1941 who proposed a theory of social learning and imitation that rejected 
behaviourist theory prevailing in the psychological discourse at that time. 
Later the work of Bandura (2001), stated a series of considerations on three 
main components of the theory, equally, that interacted with each other and 
formed a triad of reciprocity: 

• Staff with cognitive, affective and biological factors playing an 
important role. 

• the behaviour and 

• the so called environmental. 

The theory mentioned contrasted sharply with the approaches of the 
theories of human functioning that overemphasized the environmental 
factors on behaviour and learning. At the core of social cognitive theory was 
the concept of self-efficiency defined as the personal judgments made by the 
subject about his capabilities to organize and execute actions required for 
different kinds of operations. This concept has been relevant in education 
studies involving constructs such as academic performance, success and 
failure attributes, determining goals, memory, and problem solving and 
teaching. 

Another concept that underlies Bandura's theory (2001) is the one that 
refers to the capabilities available to man and that define him as such; being 
these symbolizing, planning alternative strategies, learning through 
watching someone else's experiences, self-regulated mechanisms, and the 
most distinctive capacity of human beings: self-reflection, with which the 
individual gives meaning to his experiences, explores his own knowledge 
and beliefs, engages in self-evaluation and as a result of the above changes 
his thinking and behaviour (Pajares, 2002). 
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Self-regulated, learning model 

Some self-learning models emphasized the integration of motivational and 
cognitive components of the learning process (Pintrich et al., 1993). Self- 
regulated learning requires awareness of reflection processes so that 
students are capable of evaluating their own actions and accomplishments. 
According to these authors, there are three broad categories of self- 
regulated learning: 

• Cognitive strategies of learning. Weinstein and Mayer (1986) first 
mentioned the strategies of preparation, elaboration and 
organizational as important to the development of learning in the 
classroom. 

• Preparation strategy referring to a technique where the items you 
wish to learn are mentioned aloud. Another one concerns the fact of 
emphasizing the lines of text on a passive and lacking in thought 
way. These strategies select important information for the student, 
enabling the working memory, but not necessarily cause a deep 
knowledge. 

• Elaboration strategy includes the paraphrase of the text where the 
studied material is summarized creating analogies and making a 
connection and reorganization of ideas, explaining them in such a 
way that questions and answers about the topic are arose. 

• Organizational strategies refer to the taking of notes or maps of the 
important ideas where the prose and structure of the text are 
identified, where as a result a deeper understanding than on the 
preparation techniques described above. 

Metacognition 

Flavell (1979) initially referred to metacognition as the knowledge that an 
individual has about his own cognition and to monitor and control that he 
has of the same knowledge (e.g., the student knows that is capable of 
reading fast, or that he has little capability of writing, etc). However 
Veenman et al. (2006) differentiated various aspects of metacognition, such 
metacognitive beliefs, metacognitive knowledge, feeling of knowing, learning 
judgment, metacognitive skills, higher order skills etc., revealing a lack of 
consistency and suggesting the need for further theoretical work to achieve 
a unified definition of metacognition. Metacognitive monitoring focuses on 
the progress of the cognitive process in which the person is engaged. One of 
this monitoring judgment is judgment of learning (JOL), which evaluate 
one’s memory. However, there is a consensus on two general aspects of 
metacognition: knowledge about cognition and the self-regulation of 
cognition (Veenman, Kok, & Blot, 2005). Anderson and Krathwohl (2001) 
mentioned four categories of knowledge: factual, procedural, conceptual and 
metacognitive. 

Moreover Suarez (2004) detailed the proximal development zones 
Vygotsky with respect to its implementation among subjects who were in 
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the process of learning and the benefited of using educational technology in 
network. He noted that, when learning the subject developed internal 
evolutionary processes that operated only in interaction and cooperation 
with other subjects. The zone of proximal development was defined as a 
category of analysis of the cooperative interaction among peers, which forced 
us to think that there was a theoretical basis of a significant interaction 
between peers (students), that was, based on social interaction by using the 
technologies as means of effective learning. 

Since the use of instruments might influence the results, Van Hout 
(2000), Veenman (2006) and Desoete (2008) suggested using mixed methods 
to study metacognition. 

Metacognitive and self-regulatory strategies of learning 

Most models of metacognitive control or self-regulation strategies refer to 
the planning, monitoring and control of the students over their own 
cognitive and behavioural activities (Tobias, 2009; Serra & Metcalfe, 2009; 
Zimmerman, 2008). Of course not all academic learning follows these 
phases, since in many cases; students learn the academic material tacitly, 
implicitly or unintentionally, as suggested by the model (Pintrich et al, 
1993) 

Although it seems highly correlated empirically, can be discussed 
independently. The phases have been suggested in a heuristic to guide our 
thinking and may be considered as: 

Phase 1. Planning of activities and formulation of goals. It has been 
investigated among students and it refers to the formulation of goals of 
study, skimming the text before reading, generating questions and doing an 
analysis of the problem. With these strategies, the understanding of the 
material is easier and the task is more efficient. 

Phase 2. Monitoring processes of thought in terms of academic 
performance is a key activity in the regulatory activity. This activity takes 
place when students check their understanding on the previously self 
formulated purposes. An exercise that is often done is carefully monitor the 
reading of a text, making a series of questions through the reading and 
verifying if the material is really understood. 

Phase 3. Resource management strategies, monitoring and control. 
Focuses on the strategies used by students to control, monitor and manage 
their studying environment. This item will include factors such as time and 
effort required to study; the environment that is achieved with other people 
including classmates and teachers through strategies of seeking assistance 
(Zimmerman, 2008). Such strategies help students to adapt and to change 
their way of studying making it correspond to their objectives and needs. 

Phase 4. Reactions and reflections. This phase represents several kinds 
of reactions and reflections of him in relation to the activity or context. 
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There are publications where the various elements that make up our 
investigation such as the use of hypermedia and multimedia materials, 
intentionally designed for educational purposes. The use of structured 
questionnaires for the recording before and after educational interventions, 
using quasi-experimental study designs or multi-method, like those of Igo 
(Igo et al., 2008). 

Boekaerts et al. (2000) used the term metacognitive knowledge 
presented to the student about the task, person and strategies. According to 
the work of Pintrich (1999) which refers to a scheme that relates motivation 
to self-regulated learning, this is defined as the strategies used by students 
to control and regulate their cognition (e.g., by using several strategies 
cognitive and metacognitive). A self-regulated student is aware of when he 
knows a fact or has a skill or when he doesn't. He views his achievements on 
a systematic manner and through the controlled process, so that he accepts 
as a big responsibility his goals. He, himself is the initiator of his learning 
process. 

The self-learning has taken part in various learning theories in the 
behavioural theory regulation is through the external reinforcement. On 
cognitive theory self-regulation is handled as equivalent of metacognition 
and on social cognitive theory, self-regulation is a combination of self¬ 
observation, and self-reaction. 

Teaching students to become more active learners, self-motivated is an 
issue that is continually mentioned in education. Authentic and meaningful 
classroom activities that are relevant and in real life generate knowledge 
processes on the student and conceptual changes. Although the motivational 
components are important it is equally important to include cognitive 
components on the learning models of universities (Pintrich, 2000). 

Azevedo (2005) examined the relationship between epistemological 
beliefs, metacognition and student achievement in an hypermedia learning 
environment. Epistemological beliefs refer to beliefs about the nature of 
knowledge and of wisdom. Metacognition refers to the ability to reflect, 
understand and control the learning itself. This author recognizes that the 
dimensions of metacognition and epistemological beliefs have been little 
studied in relation to learning in a hypermedia context, and leaves the door 
open for further study where the kind of processes of deep knowledge are 
developed when there is a learning multimedia environment. Bendixen and 
Hartley (2003), examined the relationship between epistemological beliefs, 
metacognition and student achievement in a hypermedia learning 
environment. Stoney and Oliver (1999), described how the use of 
multimedia, taking into account the study of self-regulated learning, can 
achieve deep levels of thinking in the adult population. Refer also to the use 
of multimedia micro-world to explore and promote the use of self-regulated 
earning and in particular examines the degree to which elevated levels of 
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thought are achieved concluding suggestive ways in which these students 
could achieve these levels. 

From another perspective, the work of Viniegra and Aguilar (1999), 
indicate that self-introspection is necessary, being aware of what happens in 
the process of developing the knowledge that, in the sense that we have 
been discussing has to do with student's self-conscious learning which they 
call, independent learning. 

Macromedia Flash ® version 2004 education 

Area (2002b) gives an example often given by teachers that apply 
multimedia materials such as Macromedia Flash ®. This program has a 
format of vector and interactive multimedia animations. There is a report 
based on constructivist theory that refers to two learning theories 
developed on the twentieth century: behaviourism and cognitivism. His 
methodological approach seeks to demonstrate that students in rebuilding a 
web site using author tools such as Macromedia Flash ® are able to develop 
a learner-centred learning, meaningful and cooperative-type (Neo & Neo, 
2001). The Macromedia Flash ® was chosen because the environment 
multimedia has features that help students to make a more effective 
management of information and to make mental models that facilitate 
learning (Mayer, 2003). Multimedia programs and multimedia learning 
environments have the potential to increase the amount and kind of 
information that are accessible to students, allowing an active participation 
and facilitating the use of higher mental processes. The learning 
environment based on the use of computers with multimedia programs can 
be compared within complex systems, which are composed of interconnected 
or interwoven parts whose links contain additional information and the 
hidden observer. As a result of interactions between elements, new 
properties emerge that can not be explained from the properties of the 
isolated elements. Thus, the process of making products in the learning 
environments based on technology is supported by the use of higher mental 
abilities (Mayer, 2001). 

Present Study 

We intended to study the use of information and communication technology 
(ITs) in particular the use of Macromedia ® Flash, in the development of 
strategies and self-regulated learning behaviours and their implications for 
the conceptual understanding of the thematic units of Epidemiology in the 
field of Dentistry Postgraduate students. 

We stated the following research questions: 

a) Can postgraduate students of dentistry based on the use of a 
multimedia program and creating educational material, from the 
perspective of psycho educational paradigms of the transmission of 
knowledge (social cognitive theory and information processing theory), 
develop strategies and behaviours in self-regulated learning on the phases 
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described as: 1. anticipation/ planning/activation 2. monitoring, 3. using 
strategies, 4. difficulty of the activity and demand? 

b) Can Dentistry postgraduate students improve their academic 
performance on the subject of Epidemiology using a multimedia program? 

Method 

Design 

A multi-method design was used combining a quantitative methodology 
(quasi-experimental pre-test / post-test, single group) with a qualitative 
approach (Protocol analysis using the coding system of self-regulation 
behaviours of Azevedo and Guthrie (2004, See Table 1). Graduate Dentistry 
students made use of the use of the educational software: Macromedia 
Flash®, on the Epidemiology class, taken as independent variable was the 
educational intervention with ITs, defined as the educational modality that 
uses electronic media to promote self-regulated learning on students: use of 
Macromedia Flash ®. As dependent variable self-regulated learning was 
taken, defined as the aware recognition of the student of the processes 
(cognitive) and cognitive strategies, metacognitive of resource management 
and motivational processes. 

Participants 

The participants were 18 graduate students (12 females and 6 males) of the 
Dentistry Specialty on Orthodontics and Maxilar Orthopedy at the 
Universidad Latina de Mexico (Celaya, Guanajuato) in the 4 th semester 
(August-December 2008 period). The mean age was 29.9 years (varying from 
26-40 year). Participating students had not previously taken the 
Epidemiology course during their academic education. 

Instruments 

In line with Joreskog, Sorbom & Valentine (2006), Ruohotie and Nokelainen 
(2000), and Nevgi (2003) the MSLQ (Pintrich et al., 1993) was used to assess 
motivational scales (expectations, task value and affection). The original 
questionnaire consisted of 81 items was reduced to 44 items based on the 
fact of Confirmatory factor analysis revealed the semantic meanings of 
items and helped to validate factorial structure of motivational strategies in 
learning. Kuder Richardson's 21 consistency test was performed (number of 
items =44) to yield acceptable values of .81. 

The MSLQ tested two types of factors: 

1. motivational factors that included components such as interest and 
value of the learning task (items 1, 4, 5, 10 and 17), components of 
usefulness of the studies (items 7, 14, 15, 21), components of self-efficiency 
(items 2, 8, 11 and 13), components of expectations of success (items 6, 9, 16, 
18, 19, 22) and anxiety and nervousness due to the exam components (items 
3, 12 and 20). 
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2. Cognitive-Factor was composed of the components: effort regulation 
(item 43), self-regulation learning components (items 32, 40, 42), 

components of persistence in the studies (items 27 and 33), metacognitive 
components of rehearse strategy (items 23, 31 and 35), metacognitive 
components of critical thinking (items 30 and 37), metacognitive 
components that focus to learning the essentials (items 24 and 34), 
metacognitive components of constructive learning (items 28 , 36, 44), 
metacognitive components of the use of keywords (item 41), metacognitive 
component of theory application (item 39) and metacognitive components on 
reflection on what was learned (items 25, 26, 29 and 38). 

The total score was 44 (minimum 0 maximum 44), considering values of 
1 (always), 0.75 (most times), 0.5 (sometimes), 0.25 (almost never or rarely), 
0 (never) for each of the items, resulting in the sum the final score obtained 
by each student. Subsequently, for statistical purposes was taken to a ratio 
of 100%. On our questionnaire a Cronbach's reliability analysis was done of 
the cognitive and motivational factors obtaining values of .85 and .87 
respectively. 

Epidemiological Knowledge Test. Consisted of 41 items and basic concepts 
necessary for the understanding of the epidemiological studies as rates, 
proportions, prevalence, incidence, mortality rates, relative risk, odds ratios, 
as well as different kinds of experimental studies, of cases and controls, 
cohort studies, meta-analysis. Cronbach's value was .78. 

Self regulation was coded according to the following coding system (see 
Appendix) 

Procedure 

The procedure was divided into 2 parts: 

Part One. A course of 14 hours (2 hours a week) on the basic handling of the 
use of Macromedia's Flash ® software led by a faculty expert in the 
management of the program and was conducted during October and 
November 2008. 

Participants received 12 weeks of simultaneous instruction during the 
Epidemiology course of the processes and cognitive strategies, 
metacognitive, resource management and motivational processes, as 
reported by Pintrich et al. (1993), Winne (2008) and Azevedo (2009): 

1. Anticipation / planning / activation: implies a conditioned conduct to 
the state of the problem as well as hierarchization of goals and sub-goals 
that can be identified by the student who when become aware of relevant 
prior knowledge before conducting its activity and during it. 

2. Monitoring. The student becomes aware that he does not known or 
understands everything deciding on alternatives to improve their 
understanding and he monitors it in relation to his targets, assessing the 
usefulness and / or appropriateness of what he is doing. 
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3. Using the strategy. The selection and use of various cognitive 
strategies for memory, learning, reasoning, problem solving and thinking, 
can include the selection of a new representation, coordination of multiple 
representations, search on the multimedia environment, summarizes what 
he has read, inspects or listens, makes inferences, asks questions, and 
elaborates what he just read, see or hear. 

4. Difficulty on the activity and demand. The student seeks assistance 
from someone with experience concerning the recent knowledge on the 
subject or of the instructions received, indicates whether the activity is easy 
or difficult and if using the media environment is more difficult than using 
the book, chooses aspects of the multimedia environment to expand reading 
and viewing of information and has expectations that a certain kind of 
representation proves to be an appropriate for a given goal. 

The students were told that they could use the strategies mentioned 
earlier in the educational intervention with Macromedia Flash ® version of 
education. 

A pre- and post-test design was used with 24 hours before and 24 hours 
after the educational intervention an exam on “Concepts of Epidemiology" 
took place. The time required to prepare the test was decided by the 
students themselves (40 to 60 minutes). This instrument was considered to 
evaluate the academic performance. In addition the MSLQ was also used as 
pre- and post-test. 

Part Two: Educational intervention. The educational intervention consisted 
on a 20 minutes activity, in line with Bannert and Mengelkamp (2007), 
where the activities of speech and the "Think aloud protocol (Ericsson & 
Simon, 1993) took place, on which students were asked to develop a 
multimedia material on their computers, called "Current Aspects of the 
Epidemiology of Oral Diseases in Mexico” and used as sources for the search 
documents that were available on the hard disk of computers from the 
computer room of Universidad Latina de Mexico in Celaya called: 

1. "Formulas of Epidemiology," which is in the PowerPoint ® format; 

2. "Ph.D. Intervention material" (which has the summaries of articles 
"Sociobehavioural risk factors in dental caries-international perspectives." 
Petersen, P. and "Dental cavities and associated Factors in Mexican school 
children aged 6-13 years”. A. Casanova-Rosado et al, both in Word format ®. 

3. Epidemiology images "as a document in jpg format. 

In the same way, portable recorders with cassettes were installed at 
each location for the sound recording of the student's verbalizations during 
the educational intervention. The teacher-researcher stayed with the 
students to answer doubts about the location of the equipment installed on 
the hard disk in order to streamline the process and the teacher who taught 
the course on Macromedia Flash ® tutored all of the time during the 
intervention the consultations on the use of the program. Students were 
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asked not to remain silent for more than thirty seconds during the activity. 
According to the methodology of the "Protocol analysis: verbal report as data 
(Ericsson & Simon, 1993). Students’ verbalizations were registered using 
recorders Stern brand, made in China, and Sony made in Japan. For the 
analysis of recordings of the students’ verbalization a transcription of each 
was done and then a comparison was made between the accuracy of the 
transcript of records with each recording register. 

The analysis was made using the coding system of self-regulated 
behaviour proposed by Azevedo and Guthrie (2004; see Appendix). The 
coding was done before reading and re-reading by the author of various 
segments of the transcripts deciding on each case if each of the segments 
were selected in general, to each of the four self-regulation dimensions and 
in particular to each of the indicators identified. In total 360 minutes of 
recordings we analyzed. The transcript of the recordings of the material led 
to a document of 20,991 words in 45 pages with lines of one space (an 
average of 2.5 leaves per participant). The recordings obtained during the 
intervention with the Macromedia Flash ® multimedia material were 
transcribed and coded according to that described by Guthrie and Azevedo 
(2004; see Appendix). 

Statistical analysis 

On the quasi-experimental approach to manage data and perform the paired 
t test the statistical program Graph Pad Prism ® 5, was used, with which 
basic biostatistics and scientific charts can be performed. For the 
quantitative approach the frequency of emission of the students’ 
verbalization was used. 

Results 

The average pre-test result on the Test of Epidemiology Concepts was 41.18 
(SD = 10.59), whereas the post-test result was average 47.04 (SD =14.09). 
The data were normally distributed. The paired t test revealed a significant 
difference between pre- and post-test results (t = -2.36; p < .05). 

The outcome of knowledge of concepts on Epidemiology showed a 
significant difference between the pre-test and post-test, demonstrating 
positive changes in terms of academic performance, which could be 
attributed to the effect of the intervention. 

Also the data from the questionnaire on self-regulated learning 
strategies were normally distributed. The score obtained in the 
questionnaire of self-regulated learning strategies was lower in the post-test 
(69.88; SD = 3.94) versus 60.13 (SD = 6.61). The t-test revealed a significant 
difference (t = 4.80, p < .0005) 

In addition, the results showed that using the multimedia program was 
not beneficial to develop self-regulatory strategies, since no much self- 
regulatory strategies were used by the students during the use of 
Macromedia ® Flash. 
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Qualitative methodology results 

Here we report the results of the frequency with which they were used self- 
regulated learning strategies on each of the 4 dimensions described above 
(Table 1). 

On the dimension Anticipation/Planning/Activation the indicator "sub¬ 
goals" was the most frequent. Here, possible operations, proposed or 
planned are offered on a exploratory manner in the documents provided, as 
well as the Activation of previous knowledge" dimension with which the 
process of selecting information is begun The students conducted a series of 
proposals intended to be made, which could be considered as part of the self- 
regulatory processes, which were verified on a new way in their academic 
life and had no reference to pre-existing states. The dimension of prior 
knowledge activation was the second most used strategy. 

As long as processing of information advanced, we found that during 
the "monitoring" stage the most frequently used indicator is that of "content 
evaluation” where the student monitored the content of his reading and was 
made aware of what he did not know. It might be that this situation is 
related to the thematic depth and variety of texts offered, coupled with the 
difficulty of the task (management of multimedia) as well as the use of 
computers for purposes other than those used by students such as 
transcription of texts or internet use. This involved mental concentration 
activities in specific stimuli as in the case of the activity with the 
multimedia program and the texts offered in PDF and jpg images, it was 
selective and changeable. The use of several readings offered a challenge for 
students, since it contained a greater density and complexity of the ideas 
that if it had only been a source of information. Supporting what was said 
before; the indicator "assessment of learning" was also frequently used. 

The ‘use of strategy’ dimension, under its various indicators provided a 
general overview of the use of epistemic resources which operate on a higher 
level, such as making inferences. This mental activity involved the use of 
mental functions such as abstraction where concepts involved in a defined 
problem are covered in a manner that allows drawing a logical cause and 
effect line. At this point it was demonstrated that the activities suggested in 
the multimedia program Flash, can be taken as the origin of the use of 
complex mental activities and that students were able to make and of which 
they give evidence, despite the difficulty and complexity of the proposed 
task. We must also consider that some of the students proved to be suitable 
subjects for such interventions to have certain language skills and practical 
conceptual domain of the expression being analyzed. The promotion of 
inferences during the use of the program and requested product was 
transformed into a creative process of high value in education. 
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Table 1 . Frequency of indicators of verbalized self-regulated learning during the 
intervention with the Macromedia Flash ® 


DIMENSION 


DIMENSION 


DIMENSION 


DIMENSION 


Forethought / 
Planning / 
Activation 


Monitoring 


Strategy use 


Size and 
difficulty of the 
activity and 
demands 


INDICATOR 

f 

INDICATOR 

f 

INDICATOR 

f 

INDICATOR 

f 

Planning 

17 

Judgment of 
learning (JOL) 

33 

Selection a new 
informational 

source 

1 

Time and 

effort 

planning 

35 

Sub goals 

50 

Feeling of knowing 
(FOK) 

2 

Goal free search 

10 

Help-seeking 

behavior 

21 

Prior 

knowledge 

activation 

25 

Self-questioning 

3 

Summarization 

6 

Task 

difficulty 

29 

Recycle goal in 

working 

memory 

7 

Content evaluation 

84 

Copying 

information 

5 

Control of context 

0 



Identify adequacy of 
information 

12 

Re-reading 

2 

Expectation of 
adequacy of 
information 

3 





Inferences 

20 







Hypothesizing 

2 







Knowledge 

elaboration 

1 




The fact that generating higher mental processes required high levels of 
attention, selection of information, memory and integration of knowledge, so 
this must be subject for further research in our educational environment. It 
should also be mentioned that the high frequency of conducting inference 
highly contrasted with the quantitative results reported by questionnaire 
self-regulated learning strategies discussed above, especially in the 
exploration of the items in the cognitive and metacognitive kind. 

The dimension of “difficulty of the activity and demands” involved 
activities where the student related all the circumstances during the task 
performance, being mostly an intentional attempt to control his behaviour 
under factors such as time and difficulty of the task; that is, the learning 
environment in the use of technology led to a behavioural change in student. 
We must recognize that to fulfil the task assigned to the group, specific 
technical skills were required to handle the Flash program and in this sense 
not all students could be compared, some used it easily while other showed 
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that the activity represented an extreme difficulty or expressed their 
opposition to the assignment. 

Discussion 

The aim of this study was to look if an multimedia intervention on students 
in the Postgraduate Dentistry Program could improve their use of self- 
regulatory learning processes. Qualitative methodology, although 
challenging and complex in practice, carried in a manner appropriate 
allowed us to extract existing meaning in the contents of the material 
analyzed. Recent literature related to our work and study (Desoete, 2008; 
Igo et al., 2008) referred to the need and usefulness of combining mixed 
method designs, because only one quantitative approach are insufficient to 
explain the experimental conditions proposed and required the 
complementary of qualitative perspectives. Other authors such as Dresel 
and Haugwitz (2008), Graesser et al. (2008) and Manlove et al. (2008) have 
used computer programs including instructions for self-regulation, applied 
in populations of different educational levels, although none of the graduate 
like that of this work or in a population belonging to the health area. Their 
quantitative methodology provided different results and different 
conclusions, although the common denominator is the promotion of self- 
regulated learning, action sometimes achieved only partially. In our work, 
the computer program did not have a specific design for self-regulation and 
of common use on disciplinary areas different from educational activity, 
such as Graphic Design (Syllabus Acatlan FES, UNAM, 2009) in spite of 
this; we note the production of self-regulation on learners. This constituted 
an undeniable strength of this work and was consistent with the state of the 
art of research on self-regulation, particularly on the metacognitive 
processes that indicated the discrepancy that exists in the ways of 
conceptualizing the constructs, ways of operationalization and assessment 
methods (whether quantitative or qualitative) (Azevedo, 2007, 2009). 

Supporting the above, let’s only mention the different names found in 
the literature for the metacognition construct: metacognitive beliefs, 
metacognitive awareness, metacognitive experiences, feeling of knowing, 
learning judgment, theory of mind, metamemory, metacognitive skills, 
executive skills, higher order skills, metacomponents, monitoring 
understanding, heuristic strategies, (Veenman et al. 2006). Likewise, the 
proposal of this work has been based on cognitive acquisition (the 
development of processes and self-regulatory behaviours) and the review of 
practical behavioural elements from a reasoned and targeted use of 
information technology. It is also necessary to mention in order to have an 
objective overview of the results, the students refer to the difficulty of the 
task, because, being self-critical, not all had a positive experience with the 
use of the program. Until recently, in the field of education in dentistry 
when attempts are being made to integrate some of the theoretical elements 
of constructivism and meaningful learning such as concept maps, with 
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software such as PowerPoint ®, to improve the academic performance 
(Kinchin & Cabot, 2007). 


Conclusion 

Postgraduate students of dentistry based on the use of a multimedia 
program and creating educational material, developed strategies and 
behaviours in self-regulated learning on the phases described as: 1. 
anticipation/ planning/activation 2. monitoring, 3. using strategies, 4. 
difficulty of the activity and demand, that could be registered by qualitative 
method. However, the results showed that using the multimedia program 
was not beneficial to spontaneously use self-regulatory strategies, since no 
much self-regulatory strategies were used by the students during the use of 
Macromedia ® Flash. 

An attempt to approach possible alternative assumptions that caused 
this outcome includes: 

Abilities of students. Pieschl (2009) mentioned that it is necessary to identify 
the perceptions that students have about the skills they recognized on 
themselves. This is represented as metacognitive monitoring and the author 
identifies it as a necessary precondition for successful learning that is a 
relationship between an estimate of their capabilities and performance. 
Underestimate their self-efficiency could have a direct effect on motivation. 
In the corresponding items to the metacognitive components of constructive 
learning scores fell between the pre-test and post-test. 

High degree of difficulty of the task. It should be noted that the completion of 
the task was the collection and use of various learning objects (in the form of 
text files, forms and images) based on Macromedia Flash ®, making this 
activity a high degree of complexity because required the use of various 
higher mental activities such as attention, memory, and organization of 
knowledge (Mayer 2003). This process of multimedia learning could not be 
registered using questionnaire forms. 

Another possible issue is that the questionnaire would, despite its 
effectiveness, the necessary adjustments to be used in learning 
environments based on computers, although the theoretical design which is 
robust and it is undeniably interesting and important in educational 
research (Duncan & McKeachie, 2005). 

Dentistry postgraduate students improved their academic performance 
on the subject of Epidemiology using a multimedia program. In Test of 
Epidemiology Concepts significant difference between pre- and post-test 
results was found which could be attributed to the effect of the intervention. 
In line with Desoete (2008) however this difference might also be the result 
of the teacher’s participation (clarification of concepts and questions about 
the topics) and learning styles that students have used all along their 
academic life. 
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Based on the theoretical work we had the opportunity to study the 
phenomenon in two different ways, and in our case complementary: using 
the questionnaire of self-regulatory learning strategies of Pintrich et al., and 
the encodings of the records recorded for self-regulatory learning strategies 
proposed by Azevedo et al. Our proposal began a study on how to assess the 
production activities and self-regulatory processes. 

However, we recognize that there are some limitations to the present 
study. First, one of the limitations is the small size of the sample. In 
addition the fact of trying to identify constructs of higher order cognition 
about cognition is methodologically a difficult task. Finally although a pre¬ 
test/post-test design with one single group has a high internal validity and 
is suitable for this sample, we could recommend a quasi-experimental 
design (non equivalent design group) for future research. 


• • • 
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Appendix 


Classes, Descriptions and Examples of the Variables Used to Code Learners' 
Self-Regulatory Behavior (Azevedo, Guhtrie, & Seibert, 2004). 


Variable 

F orethought/Planning/Activation 

Planning 


Sub-Goals 


Prior Knowledge activation 


Recycle Goal in 

Monitoring 


Description 


A plan involves coordinating the selection of 
operators. Its execution involves making behaviour 
conditional on the state of the problem and a 
hierarchy of goals and sub-goals 
Consist either of operations that are possible, 
postponed, or intended, or of states that are expected 
to be obtained. Goals can be identified because they 
have no reference to already existing states. 

Learner searches memory for relevant prior 
knowledge either before they actually begin 
performing task or during task performance. 

Learner restates the goal in working memory (WM) 
Working Memory 


Judgment of Learning (JOL) 


Feeling of Knowing (FOK) 
Self -Questioning 


Learner becomes aware that they don’t know or 
understand everything they read. 

Learner is aware of having read something in the 
past and having some understanding of it, but not 
being able to recall it on demand. 

Learner re-reads to improve his/her understanding 
of the content. 


Content evaluation 


Learner monitors content relative to goals. 


Identify Adequacy of Information 
Strategy use 


Learner assesses the usefulness and/or adequacy of 
the content they’re reading, watching, etc 


Selecting a New informational source The selection and use of various cognitive 

strategies for memory, learning, reasoning, 
problem solving, and thinking. May include selecting 
a new representation, coordinating multiple 
representation, etc. 

Goal-free search Learner searches hypermedia environment 

without specifying a specific plan or goal 
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Summarization 


Copying information 


Re-reading 


Inferences 


Hypothesizing 


Learner summarizes what he/she has just 
read, inspected, or heard in the hypermedia 
environment. 

Copying an informational source such as text and/or 
diagram from the hypermedia environment 

Learner re-reads or revisits a section of the 
hypermedia environment 

Learner makes inferences based on what 
he/she read, saw or heard in the hypermedia 
environment 

Learner asks questions that go beyond what they 
have read, seen or heard 


Knowledge elaboration 


Learner elaborates what he/she has just read, seen, 
or heard with prior knowledge 


Task Difficulty and Demands 

Time and Effort Planning 


Help-seeking Behaviour 


Task Difficulty 


Control of context 


Learner attempts to intentionally control his/her 
behaviour 

Learner seeks assistance from experimenter 
regarding either their emerging understanding of 
the topic or their instructional behaviour. 

Learner indicates one of the following: 

1) the task is either easy or difficult, 

2) using the hypermedia environment is more 
difficult than using a book. 

Learner uses features of the hypermedia 
environment to enhance the reading and viewing of 
information. 


Expectation of Adequacy of Information Learner expects a certain type of representation to 

prove adequate given the current goal. 
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